Ultrasound system for a virtual sonography team

ABSTRACT

Systems and methods for a virtual sonography team are described. An ultrasound system includes an ultrasound scanner that is configured to generate ultrasound data based on reflections of ultrasound signals transmitted by the ultrasound scanner and communicate the ultrasound data over a communication network to at least one display device and an archiver. An ultrasound machine is coupled to the ultrasound scanner and is configured to determine examination data for the ultrasound examination and communicate the examination data to the archiver over the communication network. The display device is configured to generate an ultrasound image based on the ultrasound data as part of an ultrasound examination and communicate the ultrasound image to the archiver for aggregation with the examination data into a patient record of the ultrasound examination.

FIELD

Embodiments disclosed herein relate to ultrasound systems. Morespecifically, embodiments disclosed herein relate to a virtualsonography team.

BACKGROUND

Ultrasound systems can generate ultrasound images by transmitting soundwaves at frequencies above the audible spectrum into a body, receivingecho signals caused by the sound waves reflecting from internal bodyparts, and converting the echo signals into electrical signals for imagegeneration. Because they are non-invasive and can provide immediateimaging results without delay, ultrasound systems are often used at apoint of care facility, such as in an emergency room. However, emergencyrooms are usually crowded with equipment and staff (e.g., nurses,doctors, etc.), so that visibility of the ultrasound images is generallylimited. For instance, usually only the operator of the ultrasoundsystem (e.g., the sonographer) has an unencumbered view of theultrasound images on the display screen of the ultrasound system; otherstaff are generally not able to adequately see the clinical displayscreen. This problem is often exacerbated by the small screen size ofmany ultrasound systems, which can be of a hand-held form factor, andthe limitation that most ultrasound systems include a single, clinicaldisplay. Moreover, due to security concerns, many care facilities do notpermit data from the ultrasound systems to be transmitted outside of thecare facility's in-house network, which prevents remote assistance viaan Internet connection. Consequently, most ultrasound systems areconstrained to the single, clinical display for viewing ultrasoundimages, and it is the exclusive duty of the sonographer to operate theultrasound system.

However, the sonographer is usually responsible for performing asignificant number of duties related to operating the ultrasound system.For example, modern ultrasound systems usually include numerousadjustments for imaging parameters that can be made by the sonographer.In some cases, the ultrasound systems include sophisticated signalprocessing algorithms, such as artificial intelligence (AI), machinelearning, and neural network implementations, which can be manuallyenabled by the sonographer. Additionally, the sonographer can beresponsible for annotating ultrasound images, recording biometric datafor the patient, saving/archiving ultrasound images, and the like.Because of the numerous responsibilities required of the sonographer,the sonographer is sometimes not capable of performing all the duties,and/or is sometimes forced to make a timely decision based on incompletedata. Consequently, the patient may not receive the best care possible.

Moreover, there is generally a shortage of trained sonographers, and thetime to properly train a sonographer can be significant. For example,the training can require that a sonographer candidate study, in realtime, a variety of patient conditions across a number of patients, whichusually results in many visits to care facilities over a long timeduration (e.g., months or years). Hence, there can be a lack of trainedsonographers, so that patients may not receive the best care possible.

Additionally, trauma bays are often crowded, chaotic spaces within theemergency department where many things are happening at the same time.Each person around the patient's bed has a role and getting access tothe patient to perform an ultrasound exam is difficult. Typically, thecare of the trauma patient is overseen by the attending physician who isgathering input from many sources around the patient and then directingthe care. Often the attending physician cannot see all the informationthey need, especially from the ultrasound system, in a single location.For example, at times, a critical clinical resource may need to leavetheir position to allow the ultrasound machine to be moved closer to thebedside for the critical ultrasound exam.

Speed is often of paramount importance when establishing a diagnosis fora trauma patient. The physician must address the most critical issuefirst and work on secondary issues as they arise. Many of the exams usedin the trauma bay, such as extended focused assessment with sonographyfor trauma (EFAST), rapid ultrasound for shock and hypotension (RUSH),etc., require views of the patient's anatomy from various locations onthe patient's body. At times, those locations may be inaccessible fromthe side of the patient the ultrasound scanner is on. Currently, onephysician is assigned to perform ultrasound examinations in the traumabay and the ultrasound system is often only viewable by that physician.They can scan one region of the body at a time, and the patient datafile is limited to one device.

SUMMARY

Systems and methods for a virtual sonography team are described. In someembodiments, an ultrasound system includes an ultrasound scanner that isconfigured to, as part of an ultrasound examination administered withthe ultrasound system, generate ultrasound data based on reflections ofultrasound signals transmitted by the ultrasound scanner andcommunicate, over a communication network, the ultrasound data to atleast one display device and an archiver. An ultrasound machine iscoupled to the ultrasound scanner. The ultrasound machine is configuredto determine examination data for the ultrasound examination andcommunicate, over the communication network, the examination data to thearchiver. At least one display device is coupled to the communicationnetwork. The at least one display device is configured to generate anultrasound image based on the ultrasound data as part of the ultrasoundexamination and communicate the ultrasound image to the archiver foraggregation with the examination data into a patient record of theultrasound examination.

In some embodiments, an ultrasound system includes an ultrasound scannerthat is configured to, as part of an ultrasound examination administeredwith the ultrasound system, generate ultrasound data based onreflections of ultrasound signals transmitted by the ultrasound scannerand communicate, over a communication network, the ultrasound data to adisplay device and an archiver. The display device is coupled to thecommunication network. The display device is configured to generate,with a neural network implemented at least partially in hardware of thedisplay device, an inference based on the ultrasound data andcommunicate the inference, over the communication network, to thearchiver for aggregation with the ultrasound data into a patient recordof the ultrasound examination.

In some embodiments, a method is implemented by an ultrasound system toperform an ultrasound examination. The method includes communicating oneor more tasks of the ultrasound examination to one or more displaydevices that are wirelessly coupled to an ultrasound scanner via acommunication network and transmitting, from the ultrasound scanner andover the communication network, ultrasound imaging data to the one ormore display devices. The method also includes generating, with the oneor more display devices, ultrasound examination data based on theultrasound imaging data and the one or more tasks and instructing anarchiver to aggregate the ultrasound examination data from the one ormore display devices into a patient record of the ultrasoundexamination.

Other systems, machines and methods for a virtual sonography team arealso described.

BRIEF DESCRIPTION OF THE DRAWINGS

The appended drawings illustrate examples and are, therefore, exemplaryembodiments and not considered to be limiting in scope.

FIG. 1A is a view illustrating an environment of an ultrasound systemfor a virtual sonography team according to some embodiments.

FIG. 1B is a view illustrating an environment of an ultrasound systemfor a virtual sonography team including multiple scanners according tosome embodiments.

FIG. 1C is a view illustrating a display device of the ultrasound systemaccording to some embodiments.

FIG. 1D is a view illustrating a display device of the ultrasound systemaccording to some embodiments.

FIG. 1E is a view illustrating a display device of the ultrasound systemaccording to some embodiments.

FIG. 1F is a view illustrating an environment of an ultrasound systemfor a virtual sonography team at two different locations according tosome embodiments.

FIG. 2 is a view of a user interface of the ultrasound machine used by asonographer to assign roles and/or tasks to one or more staff members ofa virtual sonography team according to some embodiments.

FIG. 3 is a view of user interfaces of a display device of an ultrasoundsystem used by a virtual sonography team member according to someembodiments.

FIG. 4 is a data flow diagram of a process implemented by an ultrasoundsystem for a virtual sonography team according to some embodiments.

FIG. 5 is a data flow diagram of a process implemented by an ultrasoundsystem for a virtual sonography team according to another embodiment.

FIG. 6 is a data flow diagram of a process implemented by an ultrasoundsystem for a virtual sonography team according to another embodiment.

FIG. 7 is a data flow diagram of a process implemented by an ultrasoundsystem to perform an ultrasound examination according to someembodiments.

FIG. 8 is a data flow diagram of a process implemented by an ultrasoundsystem to perform an ultrasound examination according to someembodiments.

DETAILED DESCRIPTION

Systems and methods for a virtual sonography team are described. In someembodiments, an ultrasound system includes an ultrasound scanner that,as part of an ultrasound examination administered with the ultrasoundsystem, generates ultrasound data based on reflections of ultrasoundsignals transmitted by the ultrasound scanner and communicates theultrasound data over a communication network to at least one displaydevice and an archiver. An ultrasound machine is coupled to theultrasound scanner. The ultrasound machine determines examination datafor the ultrasound examination and communicates the examination dataover the communication network to the archiver. Each display device iscoupled to the communication network. Each display device generates anultrasound image based on the ultrasound data as part of the ultrasoundexamination and communicates the ultrasound image to the archiver foraggregation with the examination data into a patient record of theultrasound examination.

Embodiments described herein are directed to ultrasound systems thatenable a virtual sonography team, allowing the sharing of sonographyduties, in real-time, between the sonographer who is performing anultrasound examination on a patient, and one or more staff (e.g.,doctors, nurses, clinicians, etc.) who are collocated in the same carefacility as the sonographer. Moreover, embodiments described herein aredirected to ultrasound systems that enable students (e.g., sonographercandidates) to reduce the training time required to become a certifiedsonographer, compared to training with conventional ultrasound systems.

Reference in the specification to “one example”, “an example”, “oneembodiment” or “an embodiment” means that a particular feature,structure, or characteristic described in conjunction with theembodiment can be included in at least one embodiment. The appearancesof the phrases “in one embodiment” or “in an embodiment” in variousplaces in the specification do not necessarily all refer to the sameembodiment. The processes depicted in the figures that follow areperformed by processing logic that comprises hardware (e.g., circuitry,dedicated logic, etc.), software, firmware, or a combination thereof.Although the processes are described below in terms of some sequentialoperations, it should be appreciated that some of the operationsdescribed may be performed in a different order. Moreover, someoperations may be performed in parallel rather than sequentially.

In the specification, the term “and/or” describes that threerelationships between objects may exist. For example, A and/or B mayrepresent the following cases: only A exists, both A and B exist, andonly B exist, where A and B may be singular or plural.

Ultrasound systems usually take up a lot of space, and have a singledisplay that multiple personnel may wish to observe. However, generallyonly one person (e.g., a sonographer) can capture images and video clipsat a time, obstructing the view of the display screen for other staff,since observing anatomical details closely, even with large screens, islimited to within a few feet of the screen. Further, in the educationrealm, students (e.g., sonographer candidates) may take quite a longtime to come across a wide variety of patient conditions, so eachstudent must complete each activity with a unique patient.

FIG. 1A is a view 100 illustrating an environment of an ultrasoundsystem for a virtual sonography team according to some embodiments. Asshown in FIG. 1 , the ultrasound system includes a primary device thatincludes an ultrasound scanner 101, an ultrasound machine 103, and aclinical display 104 and one or more secondary devices, e.g., secondarydevices 105, 106, 107 and 108, collectively, 105-108. In someembodiments, each of the scanner 101, ultrasound machine 103 andclinical display 104 is a portable device. In some embodiments,ultrasound machine 103 is a smart phone, or other portable device thatincludes a processor and a memory coupled to the processor to performmethods described herein. In some embodiments, clinical display 104 is adisplay on the smart phone. In some embodiments, scanner 101 includes anultrasound probe with a transducer array. Scanner 101 can be operated bya sonographer in an examination room (e.g., in an emergency departmentof the care facility), and can be connected to the ultrasound machineand/or clinical display in the examination room via a wired or wirelessconnection 102. In some embodiments, the scanner 101 wirelesslycommunicates with the one or more secondary devices, while theultrasound machine 103 and clinical display 104 are not in directcommunication with the secondary devices 105-108. That is, the scanner101 wirelessly communicates with the one or more secondary devices105-108, so that users can look at the same video stream on theircorresponding secondary devices. In some embodiments, the scanner 101communicates with the one or more secondary devices 105-108 and anarchiver 114 in a network 109, e.g., using a multicast data transferwith Wi-Fi. In some embodiments, the archiver 114 includes a server thatis connected to network 109. In some embodiments, the archiver 114includes a processor coupled to a memory to receive ultrasound data fromthe scanner 101 over network 109. In some embodiments, the network 109is a local area network, an ad-hoc network, or other network. In someembodiments, the scanner 101 transmits data to the one or more secondarydevices 105-108 using a multicast IP address. In some embodiments, thecommunication between the scanner 101 and the one or more secondarydevices 105-108 is a bidirectional communication. For example, thescanner operated by a sonographer can transmit ultrasound data to asecondary device at a physician site, and the physician can communicatea feedback regarding the scanned ultrasound data back to the scanner. Insome embodiments, the ultrasound system includes an audio channel toprovide communication between a sonographer operating the scanner and auser associated with the one or more secondary devices.

The secondary devices can be operated by one or more staff (e.g.,doctors, nurses, clinicians, etc.) and students who are collocated inthe same care facility as the sonographer who operates the scanner,ultrasound machine, and clinical display. As shown in FIG. 1 , asecondary device 105 is in a room A 111, a secondary device 106 is in aviewing room 112 and secondary devices 107 and 108 are in a room B 113.In some embodiments, the secondary device includes a smart phone, orother portable device that includes a processor and a memory coupled tothe processor to perform methods described herein. In some embodiments,a display of the secondary device is a display on the smart phone, or awearable heads-up device, such as a Google™ Glass. In some embodiments,students capture their own images/clips, perform analysis/measurementsand annotate the study, as described in further detail below.

The sonographer and the one or more staff members make up a virtualsonography team. In an example, the one or more staff members arelocated in a room of the care facility that is separate from theexamination room (e.g., a viewing room 112), and secondary device 106includes a large screen viewing device that can be simultaneously viewedby the one or more staff members. Additionally or alternatively, the oneor more staff members can be located in one or more rooms of the carefacility that are separate from the examination room (e.g., a hallway,offices, or dedicated viewing rooms), and the secondary device caninclude one or more viewing devices, one for each of the one or morestaff members. Additionally or alternatively, the one or more staffmembers can be located in an edge or corner of the examination room,away from the ultrasound machine and sonographer. Rooms A and B in FIG.1 are examples of rooms within a care facility that can be occupied byone or more staff members of the virtual sonography team operating asecondary device.

These staff members may simultaneously and in real-time during theultrasound examination operate the secondary devices to perform dutiesusually dedicated to the sonographer, such as saving images, annotatingimages, performing measurements, running artificial intelligence (AI)routines, archiving, and the like, thus offloading the responsibilitiesof the sonographer and allowing the sonographer to concentrate on thepatient. Further, these staff members can provide instructions/insightsto the sonographer. Accordingly, the virtual sonography team can providesuperior patient care compared to a sonographer operating a conventionalultrasound system. In one example, a member of the virtual sonographyteam other than the sonographer records patient biometric data andshares that data with the sonographer and other team members. Thesecondary devices can use the same archiving mechanism as the ultrasoundmachine, and/or a distinctly separate set of archivers includingarchiver 114.

FIG. 1B is a view 120 illustrating an environment of an ultrasoundsystem for a virtual sonography team including multiple scannersaccording to some embodiments. In some embodiments, the ultrasoundsystem illustrated in FIG. 1B represents a portion of the ultrasoundsystem illustrated in FIG. 1A. As shown in FIG. 1B, the ultrasoundsystem includes multiple ultrasound scanners, such as an ultrasoundscanner 121, an ultrasound scanner 122 and an ultrasound scanner 123that can simultaneously generate ultrasound data. In one example,ultrasound scanner 121 is configured to, as part of an ultrasoundexamination administered with the ultrasound system, generate ultrasounddata based on reflections of ultrasound signals transmitted by theultrasound scanner 121 and communicate the ultrasound data, over acommunication network, to at least one of a display device 124 and adisplay device 125. The one or more additional ultrasound scanners, suchas ultrasound scanner 122 and ultrasound scanner 123, are configured to,as part of the ultrasound examination, generate additional ultrasounddata based on reflections of additional ultrasound signals transmittedby the one or more additional ultrasound scanners and communicate, overthe communication network, the additional ultrasound data to at leastone of the display device 124 and display device 125. In someembodiments, display device 124 includes a wall mounted display device.In some embodiments, display device 125 includes a heads-up displayconfigured to be worn by an operator during the ultrasound examinationand display an image based on at least one of the ultrasound data andthe additional ultrasound data. In some embodiments, the display deviceof the ultrasound system is configured to, as part of the ultrasoundexamination, display simultaneously an ultrasound image based on theultrasound data and an additional ultrasound image based on theadditional ultrasound data, as described in further detail below.

In an example, ultrasound scanners 121, 122, and 123 operatesimultaneously according to a system clock provided to the ultrasoundscanners 121, 122, and 123. The system clock can control thetransmission of ultrasound from each of the scanners, so that theeffective radiated power to the patient can be reduced compared to allof the scanners 121, 122, and 123 transmitting ultrasound at the sametime. The system clock can allow for the gating of transmittedultrasound from the scanners, so that at some time intervals, less thanall (e.g., only one) of the scanners is actively transmittingultrasound. At other times, the system clock can provide for overlappingultrasound transmissions, so that two or more of the scanners 121, 122,and 123 can transmit ultrasound at the same time. The system clock canbe generated by one of the ultrasound scanners, the ultrasound machine103, a server, or any suitable device. In an embodiment, the systemclock is generated based on the anatomy being imaged or a type ofultrasound examination. For instance, for a cardiac examination, thesystem clock can be generated so that the scanners 121 and 122 transmitultrasound at the same time, and the scanner 123 transmits ultrasoundwhile the scanners 121 and 122 are not transmitting ultrasound. For alung examination, the system clock can be generated so that the scanners121, 122, and 123 overlap their transmissions of ultrasound for no morethan 20% of a specified time period, e.g., one second.

FIG. 1C is a view 130 illustrating a display device 131 of theultrasound system according to some embodiments. In some embodiments,display device 131 represents display device 124. As shown in FIG. 1C,display device 131 is configured to, as part of the ultrasoundexamination, display simultaneously an ultrasound image 132 based on theultrasound data (e.g., from a first ultrasound scanner) and anadditional ultrasound image 133 based on the additional ultrasound data(e.g., from a second ultrasound scanner). In some embodiments, displaydevice 131 is a wall mounted display that aggregates one or moreultrasound images (scans) and patient information 134 to give theattending physician a complete view of the patient's status at a time.

FIG. 1D is a view 140 illustrating a display device 141 of theultrasound system according to some embodiments. In some embodiments,display device 141 represents display device 124. In some embodiments,multiple saved images, clips, measurements and calculations areaggregated into the common patient record and can be presented ondisplay device 141.

In some embodiments, the ultrasound scanner is implemented to transmitthe ultrasound signals at a patient anatomy and the additionalultrasound scanner is implemented to transmit the additional ultrasoundsignals at the patient anatomy. Referring back to FIG. 1B, ultrasoundscanners 121, 122 and 123 can scan the same anatomy of the patient fromdifferent views. The ultrasound system can include a processorimplemented to generate a three-dimensional (3D) image of the patientanatomy based on the ultrasound data and the additional ultrasound data.The display device can be implemented to display the 3D imagesimultaneously with the ultrasound image and the additional ultrasoundimage.

FIG. 1E is a view 150 illustrating a display device 151 of theultrasound system according to some embodiments. In some embodiments,display device 151 represents display device 124. As shown in FIG. 1E,the display device 151 displays a 3D ultrasound image 152 and anultrasound image 153. In some embodiments, 3D ultrasound image 152 isgenerated based on the ultrasound scans of the same anatomy of thepatient from different views by multiple scanners (e.g., at least two ofthe scanners 121, 122 and 123). In some embodiments, ultrasound image153 is generated based on the ultrasound scan of the patient anatomy byone of the scanners 121, 122, 123.

FIG. 1F is a view 160 illustrating an environment of an ultrasoundsystem for a virtual sonography team at two different locationsaccording to some embodiments. The environment of the ultrasound systemfor a virtual sonography team includes a location A and a location Bthat communicate via a wired and/or wireless connection. Each of thelocations A and B has a camera/microphone and at least one displaydevice. As shown in FIG. 1F, an ultrasound scanner 163 is operated by apatient 162 at location A and a display device 165 and a display device166 are operated by a sonographer (expert) at a location B that isdifferent from the location A. As shown in FIG. 1F, expert 161 at site Bguides patient 162 (who may be wounded in the battle-field or contagiouswith a virus) at site A with placement of the ultrasound scanner 163 tomake a diagnosis. The patient 162 sees the expert on a display device164 at site B and operates the scanner 163. The expert 161 sees thepatient on display device 166 and an ultrasound image with additionalmedical information on display device 165 at site B.

FIG. 2 illustrates a view of a user interface 200 of an ultrasoundmachine used by a sonographer to assign roles and/or tasks to one ormore staff members of a virtual sonography team according to someembodiments. The user interface 200 can be displayed by ultrasoundmachine 103 in FIG. 1A, such as on clinical display 104 or on thedisplay of a device coupled to the ultrasound machine 103, e.g., atablet or smart phone (not shown). Referring to FIG. 2 , user interface200 includes an ultrasound image panel 202 that displays an ultrasoundimage and can also display any suitable ultrasound data, such as scannersettings, scanner temperature, imaging parameters, etc. In someembodiments, user interface 200 includes a staff panel 204 that displaysbackground information for staff members of the virtual sonography teamhaving devices connected to a scanner displayed in user interface 200,such as a staff member name, background information of the staff member(e.g., user identification data) and roles assigned to the staff,manually by the sonographer or automatically by the ultrasound system.In the example in FIG. 2 , roles and/or tasks for staff members Tony C.and Craig C. have not yet been assigned, and can be selected by thesonographer from the drop down menus in the staff panel 204, such as adrop down menu 209. The drop down menus can indicate any suitable rolesand/or tasks to reduce the burden on the sonographer, including toannotate ultrasound images, perform measurements on the ultrasoundimages, run AI algorithms, archive images, etc. As shown in FIG. 2 , therole for staff member Harald F. has been assigned as “Run AI”,indicating that this staff member is responsible for running AIalgorithms during the ultrasound examination. In some embodiments,functionalities associated with the roles/tasks are limited by presetrules to prevent certain users from performing predetermined functionsor gaining access to certain data. Such preset rules can allow certainusers to perform or have access to certain predetermined functionsand/or data. In some embodiments, the functionalities are limited by arole assigned to a user. For example, Tony C. who is a registered nurseand a DICOM expert can be assigned a role/task to archive the ultrasoundimages and be prevented from doing a cardiac expertise task.

In some embodiments, the sonographer controls which secondary devicesare allowed to connect to the scanner. The sonographer assigns rolesand/or tasks to the one or more staff members, and the roles and/ortasks are communicated from the scanner to the secondary devices. Forexample, the sonographer can designate a first staff member (personnel)to annotate images, a second staff personnel to record/save images, athird staff personnel to run a first type of AI routine, and a fourthstaff personnel to run a second type of AI routine. The sonographer canenter these selections into staff panel 204 of the ultrasound machine,which can communicate the sonographer's selections to the scanner. Inturn, the sonographer can assign the roles and/or tasks to the staffpersonnel using the scanner by wirelessly transmitting data indicatingthe selections made by the sonographer to the respective secondarydevices operated by the staff personnel.

In some embodiments, the ultrasound system automatically (e.g., withoutexplicit assignments selected by the sonographer) assign roles and/ortasks to the one or more staff members. For example, the ultrasoundsystem can determine the one or more staff members of the virtualsonography team from user identification data communicated from thesecondary devices to the scanner, and based on the user identificationdata, assign the roles and/or tasks. The user identification data caninclude any suitable data of the one or more staff, such as a job title,an expertise, a training history, and other data. The ultrasound systemcan then assign the roles and/or tasks to best suit the background ofthe staff, such as by assigning the role of running AI routines to oneor more staff members who have undergone training on AI algorithms, asindicated by the user identification data. In some embodiments, thesonographer needs to enable the automatic role assignment via theultrasound machine, such as by selecting a menu option displayed on auser interface of the clinical display to allow automatic roleassignment, with the default option indicating no automatic roleassignment is enabled (see switch 208, described below).

As shown in FIG. 2 , user interface 200 includes user controls 206 forcontrolling the ultrasound machine, such as controls for gain, depth,presets, drive signals, filters, pulse widths, and other controls. Userinterface 200 also includes a switch 208, which can be set to enable ordisable automatic role assignment to the staff members by the ultrasoundsystem, based on the staff background information indicated in staffpanel 204. In the example shown in FIG. 2 , automatic role assignment isdisabled, and the sonographer may assign roles via staff panel 204. Whenswitch 208 is disabled, a sonographer can assign roles to virtualsonography team members for ultrasound examination. When switch 208 isenabled the ultrasound system automatically assigns roles/tasks based onthe background information of the virtual sonography team members.

In some embodiments, because the virtual sonography team containsmembers who are collocated (e.g., within the same building or complex ofbuildings making up a care facility), communication between the scannerand the secondary devices does not require the Internet. In someembodiments, data is communicated between the scanner and the secondarydevices using a network dedicated to the care facility, such as a localarea network (LAN). Hence, not only is the data kept secure compared todata that is part of Internet communications, it is also technicallypossible to communicate ultrasound data between the scanner andsecondary devices. For instance, data associated with ultrasoundexaminations is often constructed according to a protocol so that theultrasound data is not routable over the Internet, preventing remote,real-time distribution of sonography roles over the Internet during anultrasound examination.

In some embodiments, multicast data may not be routable across subnetsof a network. In these cases, the ultrasound system generates a separate“starter” multicast address to initiate the communications between thescanner and multiple secondary devices. The ultrasound system alsogenerates a final multicast address and encryption information andprovides the final multicast address and encryption information to thesecondary devices.

In some embodiments, the ultrasound system enables students (e.g.,sonographer candidates) to connect to scanners within a care facilitythat significantly reduces the training time required to become acertified sonographer, compared to training with conventional ultrasoundsystems. For example, the ultrasound system can allow students locatedwithin a care facility, such as in a training room, to connect asecondary device to one of multiple scanners that are active in the carefacility, with different patients. Hence, the student can have access tomultiple patients with multiple conditions in a single visit to a carefacility, from a single location within the care facility. In someembodiments, the secondary device operated by a student has a userinterface that displays a list of active and/or scheduled ultrasoundexaminations within the care facility. The student may be able to selectone of the ultrasound examinations and connect their secondary device toa scanner for a desired type of examination. In this way, the studentcan quickly determine a suitable examination based on the student'sneeds, such as to fulfill a list of required types of examinations, andthereby reduce the time needed to complete the sonographer training.

FIG. 3 illustrates a view 300 of user interfaces of a display device ofan ultrasound system used by a virtual sonography team member accordingto some embodiments, e.g., one or more of the secondary devices 105-108.A user interface 301 includes an ultrasound imaging screen that displaysan ultrasound image and a set of controls 303. Controls 303 areselectable to capture an ultrasound image, capture an ultrasound clip,connect/pair with other devices (e.g., a scanner), provide patientinformation, review, control imaging settings, control ultrasoundmachine/scanner settings, display an amount of time (e.g., minutes)remaining for scanning, and the like. In some embodiments, a primarydevice (e.g., ultrasound machine 103 in FIG. 1 ) sets depth/2D/3D/colorand authorizes secondary users. In another embodiment, a designatedsecondary device (e.g., at a physician's site) sets depth/2D/3D/colorand authorizes a sonographer and other secondary users. In someembodiments, secondary devices, such as secondary devices 105-108receive every image frame that the primary device receives, captureimages and clips, set clip duration, prospective/retro imaging, etc. Insome embodiments, the primary and secondary devices add notes andannotations. In some embodiments, any of the display devices of theultrasound system updates patient biometrics prior to saving a firstultrasound image.

As shown in FIG. 3 , a user interface 302 is displayed on the displaydevice connected to an ultrasound scanner according to some embodiments.In some embodiments, user interface 302 is displayed prior to displayinguser interface 301. As shown in FIG. 3 , user interface 302 displays amessage to a user to scan a barcode on the scanner to connect thedisplay device with the scanner. In some embodiments, the barcode on thescanner housing allows a registered ultrasound application to connect toa network. If the barcode is damaged, a connection digit sequence can beentered manually in a manual entry of connection information field 304.In some embodiments, imaging settings control is active when the displaydevice is connected to the scanner, allowing the operator of the displaydevice to control imaging parameters for images displayed on the displaydevice. User interface 302 includes a set of controls 305 to set imagingsettings, and return to user interface 301 that includes the ultrasoundimaging screen.

In some embodiments, multiple individuals (e.g., students, etc.) canconnect to a scanner to receive live ultrasound images. In the case ofthese individuals being students, the students can practice capturingvideo clips and images, annotating studies, all from a singlesonographer using the scanner on a single patient. In this way, thetraining of students is made more efficient than training withconventional ultrasound systems, in which it is difficult or impossibleto simultaneously train multiple students during a single ultrasoundexamination.

In some embodiments, a care facility can participate in a consortium ofcare facilities for the purpose of training students. A student canview, via a user interface of their secondary device, scheduledultrasound examinations within a care facility of the consortium,“typical” types of examinations associated with a care facility or adepartment within the care facility (e.g., one department can beassociated with respiratory issues, another department can be associatedwith determining a type of cancer, and still another department can beassociated with managing pain), etc. The student can then determinewhich department of which care facility to visit, and the schedule ofthe visit, to connect their secondary device to an appropriate scannerand advance their sonography training. This training can significantlyreduce the time needed for the student to be exposed to ultrasoundexaminations of multiple patients with multiple conditions, compared toconventional training methods that do not a priori expose informationabout scheduled or typical types of ultrasound examinations fortraining. Moreover, the training methods disclosed herein facilitatetraining with live, real-time ultrasound examinations, rather thanstudies of previously-recorded examinations. Hence, the student isexposed to the real-world pace of ultrasound examinations, which can bedifficult to understand from study of pre-recorded data.

FIG. 4 is a data flow diagram of a process 400 implemented by anultrasound system for a virtual sonography team according to someembodiments. The process is performed by processing logic that maycomprise hardware (circuitry, dedicated logic, etc.), software (such asis run on a general-purpose computer system or a dedicated machine),firmware, or combinations thereof. In some embodiments, the ultrasoundsystem includes an ultrasound scanner, an ultrasound machine coupled tothe ultrasound scanner and at least one display device coupled to theultrasound machine, as described above. In some embodiments, theultrasound system includes one or more processors and a memory coupledto the processor(s) to perform the process, and the one or moreprocessors are coupled to the ultrasound scanner, the ultrasound machineand the display device to perform process 400.

Referring to FIG. 4 , process 400 includes processing logic generatingultrasound data based on reflections of ultrasound signals transmittedby the ultrasound scanner and communicating the ultrasound data, over acommunication network, to at least one display device and an archiver atblock 401. In some embodiments, processing logic generates andcommunicates the ultrasound data using one or more processors of anultrasound scanner. In some embodiments, the ultrasound scannercommunicates to the at least one display device, via the communicationnetwork, a task to be performed during the ultrasound examination withthe at least one display device. In some embodiments, the ultrasoundscanner can receive, via the communication network and from the at leastone display device, operator data for the at least one display device,and the ultrasound scanner and/or the ultrasound machine determine thetask based on the operator data automatically and without userintervention. In some embodiments, each ultrasound scanner and/or theultrasound machine receives a user selection that indicates the task.

Process 400 continues at block 402 where processing logic determinesexamination data for the ultrasound examination and communicates theexamination data to the archiver over the communication network. Thedetermination can be performed by the one or more processors of anultrasound machine. In some embodiments, the examination data includesat least one of biometric patient data, patient identification data, anadditional ultrasound image, and an imaging parameter.

At block 403, processing logic generates an ultrasound image based onthe ultrasound data as part of the ultrasound examination andcommunicates the ultrasound image to the archiver for aggregation withthe examination data into a patient record of the ultrasoundexamination. The generation of the ultrasound image can be performed byone or more processors and displayed using the display device. In someembodiments, the ultrasound data includes pre-scan-converted image dataand the at least one display device is implemented to convert thepre-scan-converted image data into scan-converted image data to generatethe ultrasound image.

In some embodiments, the ultrasound scanner and the ultrasound machineare located in a first room of a care facility and the at least onedisplay device is located in a second room of the care facility. In someembodiments, the ultrasound scanner, the ultrasound machine, and atleast one display device are located in a same room of a care facility,and the ultrasound scanner and the ultrasound machine are operated by afirst user and the at least one display device is operated by a seconduser during the ultrasound examination. In some embodiments, the displaydevice includes a neural network that generates, based on the ultrasounddata, at least one of a label, a classification, a segmentation, and aprobability and the display device communicates to the archiver the atleast one of the label, the classification, the segmentation, and theprobability for aggregation into the patient record.

FIG. 5 is a data flow diagram of a process 500 implemented by anultrasound system for a virtual sonography team according to anotherembodiment. The process is performed by processing logic that maycomprise hardware (circuitry, dedicated logic, etc.), software (such asis run on a general-purpose computer system or a dedicated machine),firmware, or combinations thereof. In some embodiments, the ultrasoundsystem includes an ultrasound scanner, an ultrasound machine coupled tothe ultrasound scanner and at least one display device coupled to theultrasound machine, as described above. In some embodiments, the displaydevice includes a server device. In some embodiments, the ultrasoundsystem includes one or more processors and a memory coupled to theprocessor(s) to perform the process, and the one or more processors arecoupled to the ultrasound scanner, the ultrasound machine and thedisplay device to perform process 500.

Referring to FIG. 5 , process 500 starts at block 501 with processinglogic generating by the one or more processors of an ultrasound scanner,ultrasound data based on reflections of ultrasound signals transmittedby the ultrasound scanner and communicating, over a communicationnetwork, the ultrasound data to a display device and an archiver, asdescribed above. In some embodiments, the display device generates anultrasound image based on the ultrasound data and displays theultrasound image, as described above. At block 502, processing logicgenerates an inference by the one or more processors with a neuralnetwork implemented at least partially in hardware of the displaydevice, based on the ultrasound data. Processing logic communicates theinference over the communication network and to the archiver foraggregation with the ultrasound data into a patient record of theultrasound examination, as described above. In some embodiments, theinference includes at least one of a label, a classification, asegmentation, and a probability. For example, the inference can includea classification of a vein versus an artery, a heart versus a kidney, orother classification. In some embodiments, the ultrasound systemincludes an archiver, as described above, and process 500 continues atblock 503 where processing logic communicates the patient record, overthe communication network, to a database of a care facility where theultrasound examination is performed, as described above. In someembodiments, processing logic performs this communication using one ormore processors of an archiver.

FIG. 6 is a data flow diagram of a process 600 implemented by anultrasound system for a virtual sonography team according to anotherembodiment. The process is performed by processing logic that maycomprise hardware (circuitry, dedicated logic, etc.), software (such asis run on a general-purpose computer system or a dedicated machine),firmware, or combinations thereof. In some embodiments, the ultrasoundsystem includes an ultrasound scanner, an ultrasound machine coupled tothe ultrasound scanner and at least one display device coupled to theultrasound machine, as described above. In some embodiments, theultrasound system includes one or more processors and a memory coupledto the processor(s) to perform the process, and the one or moreprocessors are coupled to the ultrasound scanner, the ultrasound machineand the display device to perform process 600.

Referring to FIG. 6 , process 600 starts at block 601 with processinglogic receiving operator data for an operator of the display device, asdescribed above. In some embodiments, processing logic receives theoperator data using one or more processors of an ultrasound scanner. Atblock 602, processing logic obtains a task for the ultrasoundexamination based on the operator data, and at block 603, the processinglogic communicates the task to the display device. In some embodiments,processing logic obtains and communicates the task using one or moreprocessors of an ultrasound scanner.

At block 604, processing logic selects a neural network from a pluralityof neural networks based on the task. In some embodiments, the neuralnetwork is implemented at least partially in hardware of the displaydevice, as described above. In some embodiments, processing logicperforms the selection using one or more processors of the displaydevice.

FIG. 7 is a data flow diagram of a process 700 implemented by anultrasound system to perform an ultrasound examination according to someembodiments. The process is performed by processing logic that maycomprise hardware (circuitry, dedicated logic, etc.), software (such asis run on a general-purpose computer system or a dedicated machine),firmware, or combinations thereof. In some embodiments, the ultrasoundsystem includes an ultrasound scanner, an ultrasound machine coupled tothe ultrasound scanner and at least one display device coupled to theultrasound machine, as described above. In some embodiments, theultrasound system includes one or more processors and a memory coupledto the processor(s) to perform the process, and the one or moreprocessors are coupled to the ultrasound scanner, the ultrasound machineand the display device to perform process 700.

Referring to FIG. 7 , process 700 starts at block 701 with processinglogic communicating one or more tasks of the ultrasound examination toone or more display devices that are wirelessly coupled to an ultrasoundscanner via a communication network. At block 702, processing logictransmits ultrasound imaging data from the ultrasound scanner and overthe communication network to the one or more display devices.

At block 703, processing logic generates ultrasound examination databased on the ultrasound imaging data and the one or more tasks. In someembodiments, processing logic generates the ultrasound examination databy the one or more processors with the one or more display devices. Insome embodiments, the ultrasound system includes an archiver coupled tothe one or more display devices. At block 704, processing logicinstructs an archiver to aggregate the ultrasound examination data fromthe one or more display devices into a patient record of the ultrasoundexamination, as described above.

Typically, in a trauma situation, several clinicians, doctors and/ornurses, could perform a component of a protocol such as EFAST or RUSH.Embodiments described herein enable live data sharing across multipleultrasound systems and aggregation of the data across all connectedultrasound scanners. In some embodiments of an ultrasound system for avirtual sonography team as described herein all of the connected scandata (e.g., from multiple ultrasound scanners) are available for viewingby the attending physician on a single display, such as, for example, awall mounted monitor or a handheld tablet. In some embodiments, allpatient data, images, clips, measurements, calculations, and reports arecaptured into a single record.

In some embodiments, data from two separate simultaneous ultrasoundscanners are used to perform volume measurements such as, for example,Simpsons for an ejection fraction, providing faster and better answersto the clinicians comparing to conventional techniques.

In some embodiment, data from two or more separate simultaneousultrasound scanners are used to provide the raw data needed to create 3Dand/or 4D ultrasound images.

In some embodiments, the ultrasound system includes an additionalultrasound scanner to generate, as part of the ultrasound examination,additional ultrasound data based on additional reflections of additionalultrasound signals transmitted by the additional ultrasound scanner andcommunicate, over the communication network, the additional ultrasounddata to the at least one display device. For example, ultrasoundscanners are placed at different positions to scan the patient toprovide different ultrasound imaging views. In some embodiments, theultrasound system uses different ultrasound imaging views toautomatically build an ultrasound image in 3D. In some embodiments, thedisplay device generates an additional ultrasound image based on theadditional ultrasound data and a neural network generates, based on theultrasound image and the additional ultrasound image, at least one of alabel, a classification, a segmentation, a probability, and a newultrasound image. For example, a wall mounted display device canaggregate one or more scans and patient information to give a physiciana complete view of the patient's status at one time. In an example, awearable heads-up device, such as a Google™ Glass can display individualscan information. In some embodiments, the display device communicates,over a communication network and to the archiver, the at least one ofthe label, the classification, the segmentation, the probability, andthe new ultrasound image for the aggregation into the patient record. Insome embodiments, the new ultrasound image includes at least one of asuper-resolution image and a 3D (three-dimensional) image. For example,all saved ultrasound images, clips, measurements and calculations forthe same patient are aggregated into a common patient record that can beprovided to multiple devices.

FIG. 8 is a data flow diagram of a process 800 implemented by anultrasound system to perform an ultrasound examination according to someembodiments. The process is performed by processing logic that maycomprise hardware (circuitry, dedicated logic, etc.), software (such asis run on a general-purpose computer system or a dedicated machine),firmware, or combinations thereof. In some embodiments, the ultrasoundsystem includes an ultrasound scanner, an additional ultrasound scanner,an ultrasound machine coupled to the ultrasound scanner and/or theadditional ultrasound scanner, and at least one display device coupledto the ultrasound machine, as described above. In some embodiments, theultrasound system includes one or more processors and a memory coupledto the processor(s) to perform the process, and the one or moreprocessors are coupled to the ultrasound scanner, the ultrasound machineand the display device to perform process 800.

Referring to FIG. 8 , process 800 includes processing logic generatingultrasound data based on reflections of ultrasound signals transmittedby the ultrasound scanner and communicating the ultrasound data, over acommunication network, to at least one display device and an archiver atblock 801. In some embodiments, processing logic generates andcommunicates the ultrasound data using one or more processors of anultrasound scanner.

Process 800 continues at block 802 where processing logic determinesexamination data for the ultrasound examination and communicates theexamination data to the archiver over the communication network. Thedetermination can be performed by the one or more processors of anultrasound machine. In some embodiments, the examination data includesat least one of biometric patient data, patient identification data, anadditional ultrasound image, and an imaging parameter.

At block 803, processing logic generates an ultrasound image based onthe ultrasound data as part of the ultrasound examination andcommunicates the ultrasound image to the archiver for aggregation withthe examination data into a patient record of the ultrasoundexamination, as described above with respect to FIG. 4 . At block 804,processing logic of an additional ultrasound scanner generatesadditional ultrasound data based on additional reflections of additionalultrasound signals transmitted by the additional ultrasound scanner andcommunicates the additional ultrasound data, over the communicationnetwork, to at least one display device and the archiver. In someembodiments, processing logic generates and communicates the additionalultrasound data using one or more processors of an additional ultrasoundscanner.

At block 805, processing logic generates an additional ultrasound imagebased on the additional ultrasound data. The generation of theadditional ultrasound image can be performed by one or more processorsand displayed using the display device. In some embodiments, theultrasound data includes pre-scan-converted image data and the at leastone display device is implemented to convert the pre-scan-convertedimage data into scan-converted image data to generate the ultrasoundimage, as described above with respect to FIG. 4 .

At block 806, processing logic generates, based on the ultrasound imageand the additional ultrasound image, at least one of a label, aclassification, a segmentation, a probability, and a new ultrasoundimage. In some embodiments, processing logic generates the label,classification, segmentation, probability, and/or a new ultrasound imageusing a neural network. In some embodiments, the new ultrasound imageincludes at least one of a super-resolution image and athree-dimensional image. In some embodiments, processing logicimplements the neural network using one or more processors of anultrasound scanner and/or an additional ultrasound scanner. At block807, processing logic communicates, over the communication network andto the archiver, the at least one of the label, the classification, thesegmentation, the probability, and the new ultrasound image foraggregation into the patient record. In some embodiments, processinglogic communicates the at least one of the label, the classification,the segmentation, the probability, and the new ultrasound image usingone or more processors of an additional ultrasound scanner.

As discussed above, in some embodiments the ultrasound system caninclude multiple ultrasound scanners that can simultaneously generateultrasound data.

In one example, an ultrasound system includes an ultrasound scannerconfigured to, as part of an ultrasound examination administered withthe ultrasound system, generate ultrasound data based on reflections ofultrasound signals transmitted by the ultrasound scanner andcommunicate, over a communication network, the ultrasound data to adisplay device. The ultrasound system can include an additionalultrasound scanner configured to, as part of the ultrasound examination,generate additional ultrasound data based on reflections of additionalultrasound signals transmitted by the additional ultrasound scanner andcommunicate, over the communication network, the additional ultrasounddata to the display device. The ultrasound system can also include thedisplay device configured to, as part of the ultrasound examination,display simultaneously an ultrasound image based on the ultrasound dataand an additional ultrasound image based on the additional ultrasounddata.

In an embodiment, the ultrasound scanner is implemented to transmit theultrasound signals at a patient anatomy and the additional ultrasoundscanner is implemented to transmit the additional ultrasound signals atthe patient anatomy. The ultrasound system can include a processorimplemented to generate a three-dimensional (3D) image of the patientanatomy based on the ultrasound data and the additional ultrasound data.The display device can be implemented to display the 3D imagesimultaneously with the ultrasound image and the additional ultrasoundimage. Additionally or alternatively, the ultrasound system includes aprocessor implemented to generate a biometric parameter for the patientanatomy based on the ultrasound data and the additional ultrasound data,and the display device is implemented to display an indicator of thebiometric parameter. In an example, the patient anatomy includes acardiac ventricle and the biometric parameter includes an ejectionfraction.

In one embodiment, the ultrasound scanner is implemented to transmit theultrasound signals at a patient anatomy and the additional ultrasoundscanner is implemented to transmit the additional ultrasound signals ata different patient anatomy than the patient anatomy.

In an embodiment, the display device is implemented to communicate, overthe communication network, the ultrasound image and the additionalultrasound image to an archiver for aggregation into a patient record ofthe ultrasound examination. In an example, the display device isconfigured to implement a neural network to generate, based on theultrasound image and the additional ultrasound image, at least one of alabel, a classification, a segmentation, a probability, and a newultrasound image. The display device can communicate, over thecommunication network and to the archiver, the at least one of thelabel, the classification, the segmentation, the probability, and thenew ultrasound image for said aggregation into the patient record.

In one example, the display device, the ultrasound scanner, and theadditional ultrasound scanner are located in a common room to performthe ultrasound examination. The display device can be wall mounted inthe common room.

In an embodiment, the ultrasound system includes a heads-up displayconfigured to be operator worn during the ultrasound examination anddisplay an image based on at least one of the ultrasound data and theadditional ultrasound data. Additionally or alternatively, theultrasound system can include one more ultrasound scanner configured to,as part of the ultrasound examination, generate at least more ultrasounddata and communicate it to a heads-up display. The heads-up display canbe configured to be worn during the ultrasound examination by anoperator of the one more ultrasound scanner and implemented to displayat least one ultrasound image based on the at least more ultrasounddata.

In an embodiment, the ultrasound scanner and the additional ultrasoundscanner of the ultrasound system are implemented to generate theultrasound signals and the additional ultrasound signals, respectively,at different center frequencies. Additionally or alternatively, theultrasound scanner and the additional ultrasound scanner can beimplemented to generate the ultrasound signals and the additionalultrasound signals, respectively, at different power levels. In anexample, the ultrasound scanner and the additional ultrasound scannerare operated during the ultrasound examination by a same operator. Inanother example, the ultrasound scanner and the additional ultrasoundscanner are operated during the ultrasound examination by differentoperators.

In one embodiment of the present invention an ultrasound system includesan ultrasound scanner configured to, as part of an ultrasoundexamination administered with the ultrasound system, generate ultrasounddata based on reflections of ultrasound signals transmitted by theultrasound scanner and communicate wirelessly, over a communicationnetwork, the ultrasound data to a display device. The ultrasound systemincludes an additional ultrasound scanner configured to, as part of theultrasound examination, generate additional ultrasound data based onreflections of additional ultrasound signals transmitted by theadditional ultrasound scanner and communicate wirelessly, over thecommunication network, the additional ultrasound data to the displaydevice. The ultrasound system also includes the display deviceconfigured to, as part of the ultrasound examination, generate, based onthe ultrasound data and the additional ultrasound data, an ultrasoundimage, and display the ultrasound image.

In an example, the display device is configured to, as part of theultrasound examination, generate an additional ultrasound image based onone of the ultrasound data and the additional ultrasound data, anddisplay, simultaneously with the display of the ultrasound image, theadditional ultrasound image. The display device can include a neuralnetwork implemented to generate the additional ultrasound image as a 3Dimage. The display device can be implemented to rotate or translate apoint of view of the 3D image. In an example, the display device isimplemented to communicate, over the communication network, theultrasound image and the additional ultrasound image to an archiver foraggregation into a patient record of the ultrasound examination.

In an embodiment, the ultrasound system includes one more ultrasoundscanner configured to, as part of the ultrasound examination, generateat least more ultrasound data and communicate it to a heads-up display.The ultrasound system includes the heads-up display configured to beworn during the ultrasound examination by an operator of the one moreultrasound scanner and implemented to display at least one ultrasoundimage based on the at least more ultrasound data.

In one example, the ultrasound scanner and the additional ultrasoundscanner are implemented to generate the ultrasound signals and theadditional ultrasound signals, respectively, at different centerfrequencies or different power levels. In an example, the ultrasoundscanner and the additional ultrasound scanner are operated during theultrasound examination by a same operator. Alternatively, the ultrasoundscanner and the additional ultrasound scanner can be operated during theultrasound examination by different operators. In an example, theultrasound scanner transmits the ultrasound signals towards a patientanatomy, the additional ultrasound scanner transmits the additionalultrasound signals towards the patient anatomy, and the ultrasound imagedepicts the patient anatomy.

In an embodiment, the ultrasound system includes a processor implementedto determine a biometric parameter based on the ultrasound data and theadditional ultrasound data, and the display device is implemented todisplay an indicator of the biometric parameter. The biometric parametercan include at least one of a cardiac ejection fraction, a fluid flowrate, an anatomy volume, and a blood vessel diameter.

In one embodiment of the present invention an ultrasound system includesan ultrasound scanner configured to, as part of an ultrasoundexamination administered with the ultrasound system, generate ultrasounddata based on reflections of ultrasound signals transmitted by theultrasound scanner and communicate wirelessly, over a communicationnetwork, the ultrasound data to an aggregator. The ultrasound systemalso includes an additional ultrasound scanner configured to, as part ofthe ultrasound examination, generate additional ultrasound data based onreflections of additional ultrasound signals transmitted by theadditional ultrasound scanner and communicate wirelessly, over thecommunication network, the additional ultrasound data to the aggregator.The ultrasound system also includes the aggregator configured toaggregate the ultrasound data and the additional ultrasound data intoaggregated ultrasound data and communicate, over the communicationnetwork, the aggregated ultrasound data to an archiver for archival intoa patient record of the ultrasound examination.

In an example, the communication network includes a wireless accesspoint and the aggregator is implemented to communicate the aggregatedultrasound data to the archiver including to communicate wirelessly theaggregated ultrasound data to the wireless access point. In anembodiment, at least one of the ultrasound data and the additionalultrasound data includes an ultrasound image.

In an embodiment, the ultrasound system includes a display deviceconfigured to, as part of the ultrasound examination, display at leastone ultrasound image based on at least one of the ultrasound data andthe additional ultrasound data. The display device can be implemented todisplay simultaneously an ultrasound image based on the ultrasound dataand an additional ultrasound image based on the additional ultrasounddata. In one example, the at least one ultrasound image includes a 3Dimage. In an embodiment, the at least one ultrasound image includes afour-dimensional (4D) image. In one example, the display device and theaggregator are housed in a common housing.

In an embodiment, the ultrasound scanner is implemented with a firsttransducer type to generate the ultrasound signals and the additionalultrasound scanner is implemented with a second transducer type togenerate the additional ultrasound signals. The ultrasound system caninclude an ultrasound machine coupled to at least one of the ultrasoundscanner and the additional ultrasound scanner and implemented togenerate a measurement based on at least one of the ultrasound data andthe additional ultrasound data, and communicate the measurement to theaggregator. The aggregator can be implemented to aggregate themeasurement with the ultrasound data and the additional ultrasound datainto the aggregated ultrasound data. In an example, the measurementincludes a caliper distance.

In one embodiment of the present invention an ultrasound system includesa plurality of ultrasound scanners configured to simultaneously scan atleast one patient anatomy and generate ultrasound data based on saidscan. The ultrasound system also includes a plurality of transceiverscoupled to the plurality of ultrasound scanners configured tocommunicate the ultrasound data to an archiver for aggregation into apatient record.

In one example, the ultrasound system includes a display device. Theplurality of ultrasound scanners can be configured to communicate theultrasound data to the display device over a communication network, andthe plurality of transceivers can be configured to communicate theultrasound data to the archiver using the communication network. Thedisplay device can be implemented to simultaneously display a pluralityof ultrasound images based on the ultrasound data. In an example, theplurality of ultrasound images includes a first ultrasound imagecorresponding to a first ultrasound scanner of the plurality ofultrasound scanners and a second ultrasound image corresponding to asecond ultrasound scanner of the plurality of ultrasound scanners. In anembodiment, the plurality of ultrasound images includes an additionalultrasound image generated from the ultrasound data corresponding to atleast two of the plurality of ultrasound scanners. Additionally oralternatively, the plurality of ultrasound images can include anultrasound image generated from the ultrasound data corresponding to atleast two of the plurality of ultrasound scanners.

In an embodiment, the ultrasound system includes an aggregatorimplemented to aggregate the ultrasound data for said aggregation intothe patient record, and to communicate the ultrasound data to thearchiver includes to communicate the ultrasound data to the aggregator.In an example, the aggregator is implemented to communicate theultrasound data to the archiver.

Embodiments of the ultrasound system for a virtual sonography teamdescribed herein can offload the responsibilities of the sonographer,providing better ultrasound examinations and superior patient care thanconventional ultrasound systems. The described embodiments provide newways of viewing the patient's condition in a crowded ER. Multiple staffcan have a close-up view of the scans. Staff standing twenty feet awaycan have a close view. This allows for highly experienced staff tooversee and provide direction for multiple trauma bays, or multipledisciplines to provide input.

The described embodiments allow members of a virtual sonography team tosimultaneously save images, annotate images, perform measurements, runAI routines, etc., offloading the sonographer who can concentrate on thepatient. Members of virtual sonography team can provide insight to thesonographer from within the care facility during the examination, butout of the way of the patient and staff in the examination room. Thevirtual sonography team can include staff across multiple disciplines,and their roles can be determined to match their background andtraining. Use of care-facility network alleviates security issuesassociated with Internet solutions, and affords routable data in amulticast protocol. With the example of the portable ultrasound scanner,embodiments of the ultrasound system described herein may create alimited distance secure network. The embodiments of the ultrasoundsystem described herein support training of sonography students in a waythat reduces the time needed to receive their certifications comparingto conventional ultrasound systems. The embodiments of the ultrasoundsystem described herein improve data collection compared to a singlesonographer operating a conventional ultrasound system. This results inbetter patient care, and improves the manufacturer brand comparing toconventional ultrasound systems.

It is apparent from this description that embodiments described hereinmay be embodied, at least in part, in software. That is, the techniquesand methods may be carried out in a data processing system or set ofdata processing systems in response to one or more processors executinga sequence of instructions stored in a storage medium, such as anon-transitory machine readable storage media, such as volatile DRAM ornonvolatile flash memory. In various embodiments, hardwired circuitrymay be used in combination with software instructions to implement theembodiments described herein. Thus the techniques and methods are notlimited to any specific combination of hardware circuitry and software,or to any particular source for the instructions executed by the one ormore data processing systems.

In the foregoing specification, specific exemplary embodiments have beendescribed. It will be evident that various modifications may be made tothose embodiments without departing from the broader spirit and scopeset forth in the following claims. The specification and drawings are,accordingly, to be regarded in an illustrative sense rather than arestrictive sense.

What is claimed is:
 1. An ultrasound system comprising: an ultrasoundscanner configured to, as part of an ultrasound examination administeredwith the ultrasound system, generate ultrasound data based onreflections of ultrasound signals transmitted by the ultrasound scannerand communicate, over a communication network, the ultrasound data to atleast one display device and an archiver; an ultrasound machine coupledto the ultrasound scanner and configured to determine examination datafor the ultrasound examination and communicate, over the communicationnetwork, the examination data to the archiver; and the at least onedisplay device coupled to the communication network and configured togenerate an ultrasound image based on the ultrasound data as part of theultrasound examination and communicate the ultrasound image to thearchiver for aggregation with the examination data into a patient recordof the ultrasound examination.
 2. The ultrasound system as described inclaim 1, wherein the ultrasound scanner and the ultrasound machine arelocated in a first room of a care facility and the at least one displaydevice is located in a second room of the care facility.
 3. Theultrasound system as described in claim 1, wherein: the ultrasoundscanner, the ultrasound machine, and the at least one display device arelocated in a same room of a care facility; and the ultrasound scannerand the ultrasound machine are operated by a first user and the at leastone display device is operated by a second user during the ultrasoundexamination.
 4. The ultrasound system as described in claim 1, whereinthe examination data includes at least one of biometric patient data,patient identification data, an additional ultrasound image, and animaging parameter.
 5. The ultrasound system as described in claim 1,wherein the ultrasound data includes pre-scan-converted image data andthe at least one display device is implemented to convert thepre-scan-converted image data into scan-converted image data to generatethe ultrasound image.
 6. The ultrasound system as described in claim 1,wherein the at least one display device includes a neural networkimplemented to generate, based on the ultrasound data, at least one of alabel, a classification, a segmentation, and a probability; and the atleast one display device is implemented to communicate to the archiverthe at least one of the label, the classification, the segmentation, andthe probability for said aggregation into the patient record.
 7. Theultrasound system as described in claim 1, wherein the ultrasoundscanner is implemented to communicate to the at least one displaydevice, via the communication network, a task to be performed during theultrasound examination with the at least one display device.
 8. Theultrasound system as described in claim 7, wherein the ultrasoundscanner is implemented to receive, via the communication network andfrom the at least one display device, operator data for the at least onedisplay device, and at least one of the ultrasound scanner and theultrasound machine is implemented to determine the task based on theoperator data automatically and without user intervention.
 9. Theultrasound system as described in claim 7, wherein at least one of theultrasound scanner and the ultrasound machine is implemented to receivea user selection that indicates the task.
 10. The ultrasound system asdescribed in claim 1, further comprising an additional ultrasoundscanner configured to generate, as part of the ultrasound examination,additional ultrasound data based on additional reflections of additionalultrasound signals transmitted by the additional ultrasound scanner andcommunicate, over the communication network, the additional ultrasounddata to the at least one display device, wherein the at least onedisplay device is configured to: generate an additional ultrasound imagebased on the additional ultrasound data; implement a neural network togenerate, based on the ultrasound image and the additional ultrasoundimage, at least one of a label, a classification, a segmentation, aprobability, and a new ultrasound image; and communicate, over thecommunication network and to the archiver, the at least one of thelabel, the classification, the segmentation, the probability, and thenew ultrasound image for said aggregation into the patient record. 11.The ultrasound system as described in claim 10, wherein the newultrasound image includes at least one of a super-resolution image and athree-dimensional image.
 12. The ultrasound system as described in claim1, wherein the ultrasound scanner is patient operated at a firstlocation and the at least one display device is sonographer operated ata second location that is different from the first location.
 13. Anultrasound system comprising: an ultrasound scanner configured to, aspart of an ultrasound examination administered with the ultrasoundsystem, generate ultrasound data based on reflections of ultrasoundsignals transmitted by the ultrasound scanner and communicate, over acommunication network, the ultrasound data to a display device and anarchiver; and the display device coupled to the communication networkand configured to generate, with a neural network implemented at leastpartially in hardware of the display device, an inference based on theultrasound data and communicate the inference, over the communicationnetwork, to the archiver for aggregation with the ultrasound data into apatient record of the ultrasound examination.
 14. The ultrasound systemas described in claim 13, wherein the display device includes a serverdevice.
 15. The ultrasound system as described in claim 13, furthercomprising the archiver configured to communicate, over thecommunication network, the patient record to a database of a carefacility where the ultrasound examination is performed.
 16. Theultrasound system as described in claim 13, wherein the display deviceis configured to generate an ultrasound image based on the ultrasounddata and display the ultrasound image.
 17. The ultrasound system asdescribed in claim 13, wherein: the ultrasound scanner is configured to:receive, from the display device, operator data for an operator of thedisplay device; obtain a task for the ultrasound examination based onthe operator data; and communicate, to the display device, the task; andthe display device is configured to select the neural network from aplurality of neural networks based on the task.
 18. The ultrasoundsystem as described in claim 13, wherein the display device isconfigured to determine operator data for an operator of the displaydevice and select the neural network from a plurality of neural networksbased on the operator data.
 19. A method implemented by an ultrasoundsystem to perform an ultrasound examination, the method comprising:communicating one or more tasks of the ultrasound examination to one ormore display devices that are wirelessly coupled to an ultrasoundscanner via a communication network; transmitting, from the ultrasoundscanner and over the communication network, ultrasound imaging data tothe one or more display devices; generating, with the one or moredisplay devices, ultrasound examination data based on the ultrasoundimaging data and the one or more tasks; and instructing an archiver toaggregate the ultrasound examination data from the one or more displaydevices into a patient record of the ultrasound examination.
 20. Themethod as described in claim 19, wherein the one or more tasks include afirst task of generating an ultrasound image with a first display deviceof the one or more display devices and a second task of generating aneural network inference with a second display device of the one or moredisplay devices, and the ultrasound examination data aggregated into thepatient record includes the ultrasound image and the neural networkinference.
 21. The method as described in claim 19, wherein theultrasound imaging data includes ultrasound images and the one or moretasks include a first task of generating annotations for the ultrasoundimages as part of the ultrasound examination data and a second task ofselecting one or more images from the ultrasound images to include inthe ultrasound examination data and aggregate into the patient record.